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Abstract. The Unreactive Markovian Evader Interdiction Problem (UME) 
asks to optimally place sensors on a network to detect Markovian motion 
by one or more "evaders". It was previously proved that finding the optimal 
sensor placement is NP-hard if the number of evaders is unbounded. Here we 
show that the problem is NP-hard with just 2 evaders using a connection to 
coloring of planar graphs. The results suggest that approximation algorithms 
are needed even in applications where the number of evaders is small. It 
remains an open problem to determine the complexity of the 1-evader case or 
to devise efficient algorithms. 

1. Introduction 

Network interdiction is a class of discrete optimization problems originating in 
applications such as supply chains, sensing and disease control [U[9][T0]. I n network 
interdiction one or several "evaders" traverse the network and the objective is to 
place devices for sensing or capturing the evaders (the text uses the words "sensing", 
"capturing" and "detecting" interchangeably). The problem is hard in part because 
the motion of the evaders is to some extent stochastic. Depending on the application 
such stochasticity may be caused by random errors, systematical misestimation 
of the network topology, deliberate misdirection or computational power that is 
insufficient for path optimization. The simplest model of this stochasticity is based 
on a Markov chain on the nodes of the network j7] . 

For a concrete example, consider the problem of placing police units (the sensors) 
on the highway network to catch a bank robber (the evader) moving towards a 
safehouse. Because of his haste and lack of information his motion is not predictable 
with certainty. Another application is found in problems like electronic network 
monitoring, where a limited number of devices must be placed to scan as much of 
the traffic as possible even though the traffic moves stochastically. 

These and similar applications suggest a formulation of network interdiction 
where evaders are (1) Markovian and (2) cannot or do not change their motion 
based on where the sensors were placed. The resulting optimization problem has 
been termed "Unreactive Markovian Evader Interdiction" (UME) [§j (see also earlier 
work in [2])- In UME the objective is to place sensors at nodes or edges of the 
network (generally a directed weighted graph G(V,E)), subject to a cardinality 



Key words and phrases. Network Interdiction, Markov Random Walk, Unreactive Evader, Four 
Color Theorem, Computational Complexity, NP Hard. 

1 Theoretical D ivision, Los Alamos National Laboratory, Los Alamos, New Mexico USA 87545, 
ag362@cornell.edu 2 Department of Computer Science, Cornell University, Ithaca, New York USA 
14853, |kiyan@cs. cornell.edu] 



Markovian Network Interdiction and the Four Color Theorem 



2 



constraint, so as to maximize the probability that the evader passes through a 
sensor on his way to his target. 

It was shown in |8] that when the number of evaders can be arbitrarily large 
then the UME problem is NP-hard, but the complexity of UME is an open problem 
when the number of evaders is bounded. Such complexity must arise from network 
structure and stochasticity of motion, and this problem is addressed here. 

An instance of UME contains an evader - a Markov chain given by initial "source" 
distribution a and transition probability matrix M with the property that a spec- 
ified "target" node t is a "killing" state: upon reaching t the evader is removed 
from the network. The sensors are represented by a matrix of decision variables 
r: Tij — 1 if is interdicted and otherwise. If an evader passes through a 
sensor at edge he is detected with probability du € [0, 1], termed "interdiction 
efficiency" (in general ^ d^ even if the graph is undirected). The objective is to 
choose r, subject to a budget constraint (cardinality of non-zero entries: ||r|| < 0), 
so as to maximize the probability J of "catching" the evader before he reaches the 
target t. Under certain restrictions on the Markov chain (e.g. t is an absorbing 
state) this probability J can be expressed in closed form |8]: 



(1) J(a,M,r,d) = 1 - (all-tM-MOrOd)] -1 ) , 

where the symbol means element-wise (Hadamard) multiplication. 

It would be convenient later to use a closely-related problem of "node interdic- 
tion", where the interdiction set is chosen from nodes rather than edges. Define 
"interdiction of node i" to mean setting ry = 1 V(i,j) E E (that is, interdicting all 
evaders leaving i). The UME problem on nodes is then the problem of finding an 
interdiction set Q C V maximizing J subject to ||Q|| < B. 

UME can be generalized for applications where there are multiple evaders or 
scenarios each realized with probability (Ylk w = 1). Evader k follows a 
Markov chain a( fe ) , M.^ and has probability of capture found from Eq. [l] 

(2) J( fc > (a<*> , M W , r , d) = 1 - (a^ 
The UME objective becomes maximizing the expected probability of capture: 

(3) (j) = £y fc >j(*> . 

k 

The motivation to determine the complexity of the problem is both theoreti- 
cal and practical. On the theoretical level it is known that other formulations of 
network interdiction (such as where the evaders react to the interdiction decisions 
- can see and possibly avoid the sensors) are NP-hard and hard to approximate 
[TJ 13]. On the practical level one wishes to explain the difficulty solving exactly 
even small instances of UME. Computational experiments described in |8] indicate 
that state-of-the-art integer programming packages such as CPLEX version 10.1 
may fail to efficiency solve instances of UME involving 4 evaders on networks with 
just 100 nodes (runtime > 9 hours). The proof in the next section indicates that 
already with 2-evaders UME is NP-hard, and hence in general UME can only be 
attacked using approximation algorithms (unless P=NP). 
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2. UME WITH 2 EVADERS IS NP-HARD 

The following proof is a reduction of Planar Vertex Cover - an NP-complete 
problem [6] (the word "vertex" is used interchangeably with the word "node"). Pla- 
nar Vertex Cover asks to determine whether given an undirected planar graph 
G'(V',E') there exists a set C of B' > vertices that can "cover" all the edges of 
G . The set C C V is called a "vertex cover" if all the edges are incident to at least 
one vertex in C. The proof constructs an instance of UME with possibly multiple 
evaders so that each one of the edges in E' is traversed by at least one evader, 
who then immediately moves to a special target node. These conditions mean that 
to achieve interdiction with expected probability = 1 it would be necessary and 
sufficient to interdict at least one of the incident vertices of every edge - creating a 
cover. 

The Markovian property of the evaders sets a lower bound on the number of 
evaders needed to meet those conditions - a lower bound directly related to the 
chromatic number of the graph (see therein). Famously, in the class of planar 
graphs graph coloring requires just 4 colors and polynomial time [IT] . The number 
of the evaders needed for this reduction is 2 because 2 = log 2 4 (see therein). 

It would be sufficient to consider node interdiction since edge interdiction is 
computationally equivalent to it: 

Lemma 1. The UME problem on edges is polynomially equivalent in complexity to 
UME on nodes. 

Proof. The idea is standard: split each edge to create UME on nodes; to create 
UME on edges break each node into two nodes connected by an edge. See [8] for 
details. □ 

Theorem 1. The class of UME problems on nodes with 2 evaders is NP-hard. 

Proof: Given an instance of the Planar Vertex Cover problem G'(V',E') with 
budget B' construct an instance of UME node interdiction on a derived graph 
G{V, E) as follows in steps 1-3. 

Step 1: Graph Coloring. Run the algorithm [IT] on G' and compute the color 
assignment: / : V' — ► {white, red, green, black} (abbreviated {w, r, g, b}). 

Step 2: Construction of the UME graph. Assemble G(V,E) as follows (Fig. [TJ: 

(a) The nodes are copied from V' and a special "target" node t is added: V = U'U{i} 

(b) Include the original edges E' and for all u S V (non-singletons) add an edge 
(u,t) tot: E = E'U {{u,t) \u G V and degree(u) > 0} 

(c) Define d: All nodes u £ V' can be completely interdicted: d uv = 1 Vu, v. 

Step 3: Construction of the source distributions and transition matrices. The two 
evaders would follow 3-node paths: from some source node through a "penultimate 
node" to the node t, as follows. 

Define two sets of "source nodes" Si and 52 by including all the non-singleton nodes 
with colors {w, r} in Si and all non-singletons with colors {w,g} in S 2 : 

51 = {u \u e V' \ {t} and degree(u) > and f(u) S {ui,r}} and 

52 = {u \u e V \ {t} and degree(u) > and f(u) € {w,g}}. 



Markovian Network Interdiction and the Four Color Theorem 



4 




Figure 1. The graphs G' and G. The original Set Cover instance 
is on G' (drawn with elliptical nodes and solid edges) . G is created 
by adding node t (rectangle) and the edges to t (dashed lines). 

Define two sets of "penultimate nodes" Pi and P 2 over all the non-singleton nodes 
with colors {g,b} in Pi and all non-singletons with colors {r, b} in P-i- 

Pi = {u \u G V' \ {t} and degree(u) > and f(u) G {<?, b} } and 
Pi = {u \u e V \ {t} and degree(u) > and f(u) G {r, b\ }. 

Finally, introduce evaders {1, 2}. For each evader i, let a^be uniformly distributed 
over all nodes of class Si and define M« so the evader follows the 3-node path 
discussed earlier: 

(1) = if u f Si or u = t or v £ Pi 

(2) Muv = jr if u G Si and v £ P t where z u = \\{v \ v € Pi such that (u,v) € E}\ 

(3) = 1 if u G Pi . 

An illustration of the evader motion is found in Fig. [2] In the pathological case 
where all nodes in G' are singletons, arbitrarily choose any node u ^ t and for 
i G {1,2} let = 5 UV with M^) = 0. 

Observation 1: each of the non-singleton nodes belongs to one of four disjoint set 
intersections, corresponding to the four colors {w, g, r, b}: w Si PI 52, 
g <-> S2 H Pi , r *-> Si PI P2 and 6 <-* Pi n P2. These can be viewed as the 
four bit strings of length 2: 00, 01, 10 and 11 (hence log 2 4 evaders). 

Observation 2: no source node coincides with a corresponding penultimate node: 
Pi n Si — and P 2 n S 2 — 0. Thus a direct jump from Si to t has 
probability = 0. 
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Figure 2. The graph G showing the evaders and classes of the 
non-singleton nodes. White indicates class 5i D 52, green (large 
ellipses) indicates class 52 H Pi, red (small ellipses) indicates class 
5i(~lP2 and black indicates class P±nP2- Evader motion is indicated 
by arrows. For example, the bi-directional arrow between nodes 3 
and 5 indicates that it is passed in both direction by evaders: with 
Pr > evader 1 moves along 5 — > 3 — > t and evader 2 moves along 
3 -► 5 -> t. 

Observation 3: node t could be pruned from any interdiction set without changing 
the expected interdiction probability because interdiction only affects 
outgoing evaders and node t has none. 

Notice also that the definitions of and do not guarantee that there is a 

path from every node of type 5, to node t but still meet the requirement that each 
edge would be traversed by at least one evader. An extreme example is a star graph 
such that 5i n 52 nodes surround a central node of type 5i D P^: the edges are 
traversed by evader 2 and evader 1 cannot reach node t. 

Define the UME decision problem: Is it possible to find an interdiction set Q of 
size at most B so that expected interdiction probability (J) = 1? 

Claim. The UME decision problem with budget B set to B' is a "YES" instance iff 
a B' '-cover exists for the graph G . 

Justification: The pathological case where all nodes are singletons is a UME 
"YES" instance for any B > since the evader cannot reach the target and it is 
also a Planar Vertex Cover "YES" instance (B' > 0) since no edges exist. 
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Suppose now that a non-pathological UME instance is a "YES" instance. Since 
adjacent nodes in G' have different colors, Observation 1 implies that any two 
adjacent nodes u, v € V \ {t} must be different by at least one bit. Thus 3evader i 
such that one of {u, v} is a source node (i th bit = 0) while the other is a penultimate 
node (i th bit = 1). The definitions of and imply that evader % traverses 
through (u, v) with Pr > 0. Since this is a "YES" instance with (J(Q)) = 1, the 
interdiction set Q must contain at least one of the endpoints {u, v} (whether or not 
node t <E Q, by Observation 3). Therefore the set Q is a cover for graph G' . 

Conversely, if the Planar Vertex Cover decision problem is a 'YES" instance then 
there exists a vertex cover set C. From Observation 2 and the definition of 
it follows that with Pr — 1 the evader passes on his way to the target through 
the set of edges in the original graph: E' = {(u, v) \u, v 6 V \ {t} and u^i^u}. 
Therefore make Q = C and get that Vz, evader i will be interdicted with expected 
probability = 1. This a UME "YES" instance. 

3. Discussion 

The proof in this paper shows that UME is NP-hard even under fairly restrictive 
conditions: (1) only 2 evaders are needed, (2) the interdiction efficiencies d are 
everywhere = 1, (3) the graph is unweighted and undirected, and (4) the evader 
has the non- retreating property [7]. It remains to determine whether the result 
could be improved to the case of 1 evader or to find a polynomial-time solution. It 
is interesting that the color-based technique introduced in the proof could be used 
to solve other vertex cover problems, such as vertex cover for a bipartite graph 
(2-colorable, so only 1 evader is needed). Yet, on bipartite graphs vertex cover can 
be solved in polynomial time j5]- 
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